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(54) Tttte: POSITION SENSING OF A REMOTE TARGET 




| (57) Abstract 

Apparatus for the position sensing of a remote target A preferred embodiment is used to control the position of a graphical pointer on 
a computer screen. A tight emitting diode illuminates the head of the computer operator and an array of detectors detect radiation returned 
by a retroreflector attached to the head of the operator. Signal processing means is included to derive information about the position of the 
operator's head from the detector outputs and convert it to a form suitable for input to computer. 
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POSITION SENSING QF A REMOTE TARGET ■ 

The current invention is concerned with position sensing of a remote target 
and has particular, but not exclusive, relevance to the computer industry. 

The computer industry is a rapidly evolving area of technology where 
manufacturers are constantly seeking innovations which will provide an 
advantage over competitors products. One particular area which is the 
object of much attention is the Human Computer Interface (HCI) or Man 
Machine Interface, that is, the means by which the computer operator 
communicates with the computer, inputting data and commands and receiving 
information . 

The use of menu driven and windowing software greatly enhances the user 
friendliness of many computer related products, especially if such software 
is used in conjunction with a computer mouse or trackerball. These are 
handheld devices which allow the user to interact with software/hardware by 
moving a graphical pointer around on a computer screen, making selections 
from displayed options, manipulating software windows, drawing etc. by 
moving the mouse over a surface or operating the tracker ball by thumb 
motion and taking action by depressing a button. 

A particular application of the current invention offers a system where the 
handheld mouse is redundant and the pointer on screen moves in response to 
movements of the operators head. This leaves both hands free to operate 
the keyboard which is particularly advantageous to, for example, typists. 

The control of the cursor by movements of the operators head is very 
ergonomic and intuitive. The equivalent to depressing the mouse button 
may be achieved either by additional buttons on the keyboard or by 
detection of specific head movements such as a shake or nod. This may be 
achieved without the need for any wires, batteries or other impedimenta 
on the operator and may be implemented at a cost comparable to the 
existing mouse. 
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There are various ways in which the motion of the operators head can be 
used to control the cursor position on the screen. 

Firstly, the motion of the head and the cursor may be locked together 
exactly, regardless of the speed of motion of the head. This is an 
absolute mode and is used in the implementation described in this 
specification. 

Secondly, the motion of the head and cursor may be coupled in a manner 
dependent on both the position and speed of motion of the head. This is a 
relative mode and is the speed sensitive option available with some mouse 
systems. Slow movement of the head by one cm corresponds to movement of 
the cursor by one centimetre while rapid movement of the head by one cm 
results in say four cm of cursor movement. This option would be available 
with the system described and could be implemented in software or hardware. 

Thirdly, the cursor may move only in response to motion of the head and not 
the absolute position of the head. The absolute head position can be 
extracted when a signal is present, but that signal is only present during 
motion . 

Many other applications of the invention are envisaged: by exploiting the 
retroreflecting properties of the human eye, eye movements may be sensed to 
ensure that the driver of a vehicle is not falling asleep; the invention 
may be used to track objects other than the operators head; by movement of 
hand or foot or limb stump, disabled persons may control software driven 
apparatus carrying out any number of tasks; eye movement and head movement 
scanned in combination will allow gaze direction information to be 
extracted; in industry, process control in a dirty environment could be 
effected with the hands free; a pair systems of the invention could be 
used to obtain two directional fixes on a target, allowing the position in 
three dimensions to be established. 
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The invention makes use of electromagnetic radiation emanating from an 
object in deriving information about the position of that object. Such 
radiation may originate from a source fixed in relation to the object* may 
be reflected off the object or the object itself could be the source of 
radiation. For the purpose of this specification, "emanating from the 
object" should be taken to include any of these cases. 

The radiation emanating from the object is used to illuminate an area of a 
plane. This may be achieved, for example, by gathering some of the 
radiation using a lens or by using a pinhole. Then, by the parallax 
effect, the two dimensional position of the illuminated area is dependent 
on the angular position of the target. 

According to this invention, apparatus for controlling the position of a 
graphical pointer on a computer screen comprises: 

means for providing electromagnetic radiation emanating from a region 
fixed in relation to part of a computer operators body; 

means for providing an area, illuminated by said electromagnetic 
radiation, whose position in two dimensions is dependent on the angular 
position of said part of a computer operators body; 

means for detecting electromagnetic radiation and producing an 
electrical output which is dependent on the position of the area of 
illumination and 

signal processing means for deriving information about the angular 
position of said part the operators body from the electrical output. 

In a preferred embodiment, the electromagnetic radiation emanates from a 
region fixed in relation to the computer operators head. 

In a preferred embodiment the means for detecting electromagnetic radiation 
and producing an electrical output which is dependent on the position of 
the area of illumination comprises a position sensitive detector. 
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In another preferred embodiment the means for detecting electromagnetic 
radiation and producing an electrical output which is dependent on the 
position of the area of illumination comprises an array of electromagnetic 
radiation detector elements, each of which produces an output which is 
dependent on the intensity of radiation incident thereon. 

A further preferred embodiment includes filtering means for blocking 
radiation of a different wavelength to that emanating from the region fixed 
in relation to the head of the operator. 

In another preferred embodiment the electromagnetic radiation is in the 
visible region of the electromagnetic spectrum. 

In a further preferred embodiment the electromagnetic radiation is in the 
infrared region of the electromagnetic spectrum. 

In a further preferred embodiment the source of electromagnetic radiation 
is a light emitting diode. 

In a further preferred embodiment each detector element comprises a 
photodiode . 

A further preferred embodiment includes a scattering diffuser screen and an 
optical lens, arranged so that radiation emanating from the direction of 
the operators head is gathered by the lens and concentrated on an area on 
the diffuser screen. 

A further preferred embodiment includes a fluorescent label fixed to the 
head of the operator. 

A further preferred embodiment includes a phosphorescent label fixed to the 
head of the operator. 
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In a further preferred embodiment the source of radiation is situated 
substantially on a line between the head of the operator and the array of 
detector elements and a retroreflector is fixed to the head of the 
operator. 

A further preferred embodiment includes means for modulating the output of 
the radiation source and corresponding means for demodulating the output of 
the detectors. 

The general principles of the current invention may be applied to the 
position sensing of a remote target in general. In situations where the 
source of radiation is the target itself (for example infrared emission 
from the human body), passive systems are envisaged which could be applied, 
for example, in security systems. 

The invention will now be described with reference to the following figures 
in which: 

Figure 1 shows part of an embodiment of the invention in which the source 
of radiation is fixed to the operators head; 

figure 2 shows part of an embodiment of the invention which utilises a 
fluorescent label, used in conjunction with a remote source of radiation, 
to provide radiation emanating from the direction of the operators head; 

figure 3 shows part of an embodiment of the invention which uses a 
retroreflector used in conjunction with a source of radiation to provide 
radiation emanating from the direction of the operators head; 

figure 4 shows electronic circuitry used to process the outputs of the 
detector elements; 

figure 5 shows further processing circuitry used to derive information, in 
one dimension, about the position of the target and 
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figure 6 is a representation of the interface between the current invention 
and a personal computer. 

Referring to figure 1, a simple embodiment of the invention comprises a 
source of electromagnetic radiation 1, for example a light emitting diode, 
attached to the head of the operator 2. Source 1 could, for example, take 
the form of a penlight tucked behind the ear. Radiation from source 1 is 
gathered by lens 3 and concentrated on an illuminated area 4 of a forward 
scattering diffuser screen 5 which could be a sheet of ground glass or 
greaseproof paper. 

A backward scattering diffuser screen may prove equally effective (for 
example a sheet of white paper). In this case, the scattered light would be 
reflected and diodes 6a - 6d would be situated on the opposite side of the 
screen 5 to that shown. 

An array of electromagnetic radiation detector elements 6a, 6b, 6c and 6d, 
conveniently located in the vicinity of computer screen 7. detects 
radiation from illuminated area k. The output of each detector 6a - 6d 
depends on the position, in two dimensions, of illuminated area <4. The two 
dimensional position of illuminated area ^ depends, in turn, on the angular 
position of source 1. controlled by movements of the head of the operator 
2. 

In practice, a 2 x 2 array of detector elements was used, but arrays of 
other dimensions may also serve adequately. Throughout this specification 
the term array should be taken to include arrays of all dimensions 
including 1x1. 

Inclusion of optical filter 8. whose passband is based on the wavelength of 
radiation produced by source 1, allows discrimination against radiation 
from other sources and hence improves the performance of the system. 

Typically, detector elements 6a - 6d would take the form of photodiodes. 
The use of other types of photodetector , for example phototransistors . is 
also feasible. 
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As an alternative to an array of detectors, a position sensitive detector 
such as device S1300 available from Hamamatsu Photonics UK Ltd may be used 
to derive an electrical signal which is dependent on the position of 
illuminated area 4. 

Referring to figure 2, a fluorescent marker 9 is attached to the head of 
the operator 2. The marker 9 may, for example, be incorporated into a pair 
of spectacles or other article worn by the operator. Radiation source 1 is 
placed so that the head of the operator 2, and in particular marker 9, is 
within its field of illumination. 

During operation marker 9 is illuminated by source 1, and produces, by 
fluorescence, an emission of radiation. Radiation from marker 9 is 
gathered by lens 3 and concentrated on an illuminated area 4 of diffuser 
screen 5. As before, detector elements 6a - 6d detect radiation from area 
4 and produce an output dependent on the position of the operators head 2. 

By using a fluorescent marker 9 and an optical filter 8 whose passband is 
based on the radiation produced by fluorescence, it is possible to 
discriminate against inter alia radiation produced by source 1 and 
reflected off objects other than the marker on the operators head 2. 

Referring to figure 3, illumination is supplied by a single Light Emitting 
Diode (LED) 1 situated substantially on the line between the head of the 
operator 2 and the array of detectors 6a - 6d and arranged so that the head 
of the operator 2 lies within the field of illumination. The LED used in 
this particular embodiment was a Siemens SFH 487 GaAs infrared emitter 
nominally operating at 880nm producing a 40 degree cone angle of 
illumination. 

Modulation of the output from LED 1 is achieved by means of a 4kHz square 
wave driving current, typically switching from 0 end 100mA. Modulation is 
used to allow measurement of illumination originating from the LED 1 whilst 
discriminating against DC and mains derived frequency components of the 
background illumination. 
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A retroreflector 10 is attached to the head of the operator 2 in order to 
provide a strong return of radiation in the direction of LED 1. A perfect 
retroreflector would return a narrow beam of parallel light which would be 
blocked by LED 1 itself. For the purpose of this invention an "imperfect" 
retroreflector returning a beam in a narrow cone angle of about 2 degrees 
is most suitable and for the purpose of this specification the term 
"retroreflector" should be taken to mean any device providing sufficient 
return of radiation for operation of the invention. 

Some of the reflected radiation passes LED 1 and, after passing through 
optical filter 8 (optional), falls on diffuser screen 5 to produce an 
illuminated area l \. Diffuser screen 5 is located behind LED 1 so, by the 
parallax effect, the two dimensional position of illuminated area 4 is 
dependent upon the angular position of retroreflector 10 and hence the 
operators head 2. Therefore photodiodes 6a - 6d each produce an output 
which is dependent on the angular position of the operators head 2. The 
system may be improved by inclusion of a lens 3 to gather returned 
radiation and focus it into a more concentrated image on screen 5- 

Also, it is feasible that screen 5 may be omitted so that radiation 
returned from retroreflector 10 falls directly on to the array of detectors 
6a - 6d producing an area of illumination there. 

Referring to figure A, the circuitry represented therein is replicated for 
each of the four photodiodes 6a - 6d shown in figures 1-3- 
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The signal from each photodiode 6a - 6d passes through a current to voltage 
converter stage 11. The preferred option for amplifier 12 used therein is 
a low noise operational amplifier with wide dynamic range. Where 
modulation of the illuminating radiation is used, a high pass filter 13 is 
used to discriminate against AC, DC and noise components of the signal 
which are due to background illumination. The cutoff of the filter used 
represents a balance between rejection of said AC, DC and noise components 
on the one hand and avoiding phase shifting of the modulated signal on the 
other. The latter gives rise to errors when summing the signals from each 
photodiode. With the 4 kHz modulation frequency associated with the 
apparatus of figure 3. a 2 kHz fcutoff frequency was used. 

The demodulated signal is then rectified and integrated at stage 14. 

In order to reduce the dependence of the system on the distance of 
the operators head, automatic gain control of the signal is achieved by 
summing the four rectified, demodulated signals respectively associated 
with the four photodiodes 6a - 6d and dividing each signal by the sum. The 
summation takes place at stage 15 which includes an offset voltage in order 
to limit the gain. 

The individual and summed signals are each fed to stage 16 comprising an 
AD53^ device supplied by Analogue Devices) where automatic gain control is 
effected. 

Referring to figure 5» the horizontal signal is derived 17 by combining the 
four range compensated signals to obtain the quantity (v o *v c ) - ( v b * v d ). 
where v o , v b etc. are the range compensated signals respectively derived 
from photodiodes 6a, 6b etc. 

The magnitude of the systems response to lateral movements of the operators 
head may be adjusted at output limiter/sensitivity control stage 18. 

A similar arrangement to that shown in figure 5 is used to derive the 
vertical signal by combining the four range compensated signals to obtain 
the quantity (v w *v |( ) - (v.*v t ). 
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Referring to figure 6, the analogue outputs, from stage 18 figure 5. 
representing horizontal and vertical displacement are each converted to a 
12 - bit digital value by a two channel, 12 bit analogue to digital 
converter 19. The use of 12 bits permits a resolution of 4096 in each axis 
which is adequate for translation into personal computer screen coordinates 
of about 1024 pixels in each axis. The digitised horizontal and vertical 
displacement values are further processed by serial protocol conversion 
hardware 20 to provide an encoded RS232 sequence combining the displacement 
values and the status of a number of additional inputs 21 (in this case 
two) which take the place of the mouse buttons. In this embodiment, these 
inputs were derived from contact switches attached to the computer 
keyboard. An alternative embodiment takes action, as if a conventional 
mouse button has been pressed, in response to specific head movements (eg a 
nod or shake) . 

An implementation of the serial protocol conversion hardware 20 has been 
constructed using analogue to digital convertors and programmable logic 
arrays. However, other means for meeting the requirements specified above 
will be apparent to those skilled on the art. 

The software package used was Windows (TM) version 3.1, produced by 
Microsoft (RTM) Corporation, run on a Compaq (TM) SLT personal computer. 
The Windows (TM) mouse device driver software was modified to accept the 
horizontal and vertical displacement information along with the information 
concerning the status of the additional inputs via the serial interface of 
the personal computer 22. This information is received on an interrupt 
basis. Each horizontal, and each vertical, datum received is relative to 
the last and the mouse driver software tracks this information passing an 
appropriate scaled and signed datum to the windows software. Thus the 
driver clips the coordinates of the remote position sensor to the actual 
screen coordinates. 

The information from the additional inputs 21 corresponding to the left 
button of a conventional mouse was used as for a conventional mouse, that 
is to "click" on software options displayed on the computer screen. The 
other switch is used to reset the coordinates to the middle of the screen. 
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Claims. 

1. Apparatus for controlling the position of a graphical pointer on a 
computer screen comprising: 

means for providing electromagnetic radiation emanating from a region 
fixed in relation to part of a computer operators body; 

means for providing an area, illuminated by said electromagnetic 
radiation, whose position in two dimensions is dependent on the angular 
position of said part of a computer operators body; 

means for detecting electromagnetic radiation and producing an 
electrical output which is dependent on the position of the area of 
illumination and 

signal processing means for deriving information about the angular 
position of said part the operators body from the electrical output. 

2. The apparatus of claim 1 where the electromagnetic radiation emanates 
from a region fixed in relation to the computer operators head. 

3. The apparatus of claim 2 and further including a fluorescent or 
phosphorescent label fixed to the head of the operator. 

The apparatus of claim 2 where the source of radiation is situated 
substantially on a line between the head of the operator and the array of 
detector elements and a retroreflector is fixed in relation to the head of 
the operator. 

5. The apparatus of claim 4 where the means for detecting electromagnetic 
radiation and producing an electrical output which is dependent on the 
position of the area of illumination comprises a position sensitive 
detector. 
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6. The apparatus of claim 4 where the means for detecting electromagnetic 
radiation and producing an electrical output which is dependent on the 
position of the area of illumination comprises an array of electromagnetic 
radiation detector elements, each of which produces an output which is 
dependent on the intensity of radiation incident thereon. 

7. The apparatus of claim 6 and further including filtering means for 
blocking radiation of a different wavelength to that emanating from the 
region fixed in relation to the head of the operator. 

8. The apparatus of claim 7 where the electromagnetic radiation is in the 
visible region of the electromagnetic spectrum. 

9. The apparatus of claim 7 where the electromagnetic radiation is in the 
infrared region of the electromagnetic spectrum. 

10. The apparatus of claim 9 where the source of electromagnetic radiation 
is a light emitting diode. 

11. The apparatus of claim 10 where each detector element comprises a 
photodiode . 

12. The apparatus of claim 11 and further including a scattering diffuser 
screen and an optical lens, arranged so that radiation emanating from the 
direction of the operators head is gathered by the lens and concentrated on 
an area on the diffuser screen. 

13. The apparatus of claim 12 and further including means for modulating 
the output of the radiation source and corresponding means for demodulating 
the output of the detectors. 
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14. Apparatus for the position sensing of a remote target comprising: 

means for providing electromagnetic radiation emanating from a region 
fixed in relation to the target; 

means for providing an area, illuminated by said electromagnetic 
radiation, whose position in two dimensions is dependent on the angular 
position of the target; 

means for detecting electromagnetic radiation and producing an 
electrical output which is dependent on the position of the area of 
illumination and 

signal processing means for deriving information about the angular 
position of the target. 
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